Bias - variance tradeo of soft decision trees
نویسندگان
چکیده
This paper focuses on the study of the error composition of a fuzzy decision tree induction method recently proposed by the authors, called soft decision trees. This error may be expressed as a sum of three types of error: residual error, bias and variance. The paper studies empirically the tradeo between bias and variance in a soft decision tree method and compares it with the tradeo of classical crisp regression and classi cation trees. The main conclusion is that the reduced prediction variance of fuzzy trees is the main reason for their improved performance with respect to crisp ones.
منابع مشابه
SE-Trees Outperform Decision Trees in Noisy Domains
As a classi er, a Set Enumeration (SE) tree can be viewed as a generalization of decision trees. It can be shown that, at the cost of a higher complexity, a single SE-tree encapsulates many alternative decision tree structures. An SE-tree enjoys several advantages over decision trees: it allows for domain-based userspeci ed bias, it supports a exible tradeo between the resources allocated to le...
متن کاملMachine Learning Bias, Statistical Bias, and Statistical Variance of Decision Tree Algorithms
The term \bias" is widely used|and with diierent meanings|in the elds of machine learning and statistics. This paper clariies the uses of this term and shows how to measure and visualize the statistical bias and variance of learning algorithms. Statistical bias and variance can be applied to diagnose problems with machine learning bias, and the paper shows four examples of this. Finally, the pa...
متن کاملImproved customer choice predictions using ensemble methods
In this paper various ensemble learning methods from machine learning and statistics are considered and applied to the customer choice modeling problem. The application of ensemble learning usually improves the prediction quality of flexible models like decision trees and thus leads to improved predictions. We give experimental results for two real-life marketing datasets using decision trees, ...
متن کاملEstimating Suspended Sediment by Artificial Neural Network (ANN), Decision Trees (DT) and Sediment Rating Curve (SRC) Models (Case study: Lorestan Province, Iran)
The aim of this study was to estimate suspended sediment by the ANN model, DT with CART algorithm and different types of SRC, in ten stations from the Lorestan Province of Iran. The results showed that the accuracy of ANN with Levenberg-Marquardt back propagation algorithm is more than the two other models, especially in high discharges. Comparison of different intervals in models showed that r...
متن کاملExploring estimator bias-variance tradeoffs using the uniform CR bound
We introduce a plane, which we call the delta-sigma plane, that is indexed by the norm of the estimator bias gradient and the variance of the estimator. The norm of the bias gradient is related to the maximum variation in the estimator bias function over a neighborhood of parameter space. Using a uniform Cramer-Rao (CR) bound on estimator variance a delta-sigma tradeo curve is speci ed which de...
متن کامل